EPJ manuscript No. 

(will be inserted by the editor) 



: 

o . 
o 



(N Two-cycles in spin-systems: multi-state Ising-type ferromagnets 



< 



G 

O 
O 



> 

oo 

o 

oo 

o 
o 

-I— > 



T3 

c 

o 
o 



X 



D. Bolle and J. Busquets Blanco 

Instituut voor Theoretische Fysica, Katholieke Universiteit Leuven, Celestijnenlaan 200 D, B-3001 Leuven, Belgium 
Received: date / Revised version: date 

Abstract. Hamiltonians for general multi-state spin-glass systems with Ising symmetry are derived for 
both sequential and synchronous updating of the spins. The possibly different behaviour caused by the 
way of updating is studied in detail for the (anti)-ferromagnetic version of the models, which can be 
solved analytically without any approximation, both thermodynamically via a free-energy calculation and 
dynamically using the generating functional approach. Phase diagrams are discussed and the appearance 
of two-cycles in the case of synchronous updating is examined. A comparative study is made for the fa- 
lsing and the Blume-Emery-Grimths ferromagnets and some interesting physical differences are found. 
Numerical simulations confirm the results obtained. 

PACS. 05.70.Fh Phase transitions, general studies - 64.60.Cn Order- disorder transformations; statistical 
mechanics of model systems - 75.10.Hk Classical spin models 



1 Introduction 

Recently, there has been renewed interest in the possi- 
bly different physics arising from the sequential or syn- 
chronous execution of the microscopic update rule of the 
spins in disordered systems. For example, the Little- Hop- 
field model on a random graph |Tj and random field Ising 
chains [2], both with synchronous updating have been 

, studied. For both systems governed by a pseudo- Hamil- 
tonian of binary Ising spins (i.e., a Hamiltonian depen- 
dent on the inverse temperature) first derived by Peretto 
PI, it has been shown that the physics is asymptotically 
identical to that of the sequential version of the models. 
Furthermore, for a class of attractor neural networks with 
spatial structure (one dimensional nearest-neighbour in- 
teractions and infinite-range interactions) governed again 
by Peretto's pseudo-Hamiltonian it has been found 4 that 
dynamical transition lines for synchronous updating in pa- 
rameter space are exact reflections in the origin of those 

■ in sequential updating and that the relevant macroscopic 
observables can be obtained from those of sequential up- 
dating via simple transformations. 

It is yet unclear to what extent the two types of spin 
updating lead to such common equilibrium features. For 
example, it is known that the phase diagram of the se- 
quential and synchronous Hopfield neural network model 
in the replica-symmetric approximation are different (e.g. 
the retrieval region is slightly larger in the synchronous 
case) [H] whereas the phase diagram of the Sherrington- 
Kirkpatrick (SK) spin-glass model [6 remains unaffected 
by this difference in updating |7|. 

The aim of this work is to get more insight in the pos- 
sible differences between sequential and synchronous up- 
dating by studying more complicated models containing 



multi-state spins. In particular, we look at the Q-Ising and 
Blume-Emery-Griffiths (BEG) (anti)-ferromagnetic mod- 
els which can also be related to a neural network model 
storing only one pattern. We discuss the relevant phase di- 
agrams as well as the dynamics using the generating func- 
tional approach. We are not aware of any previous studies 
comparing these two types of updating for these models. 
It turns out that for the Q-Ising model again the tran- 
sition lines for synchronous updating in parameter space 
are exact reflections of those in sequential updating. For 
the BEG model, however, the two forms of updating lead 
to different physics in part of the parameter space. 

The paper is organized as follows. In section|21 we gen- 
eralize the results of Peretto by writing down (pseudo) 
Hamiltonians based on the detailed balance property for 
multi-state spin models with random interactions for both 
sequential and synchronous updating. In the zero- tem- 
perature limit the corresponding Lyapunov functions are 
obtained. In section^ the phase diagrams for the Q-lsing 
(anti)-ferromagnets are studied in detail, emphasizing the 
differences between both forms of spin updating. Section^ 
discusses the statics of the BEG (anti)-ferromagnet and 
section El the dynamics using the generating functional 
approach. Numerical simulations confirm the results ob- 
tained. Finally, in section El some concluding remarks are 
presented. 



2 Models and Hamiltonians 

2.1 The Q-lsing model 

Consider a model of N spins which can take values 0$, i — 
1, . . . , N from a discrete set S = { — 1 = Si < S2 < ■ ■ ■ < 



2 
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+1}. Given the configuration tr(t) 
, N, the local field in spin i equals 



Wi(t)} t i 



distribution can be written in the Boltzmann form with a 
Hamiltonian dependent on the inverse temperature 



JY 



N 



3=1 



(1) 



^exp (Pihii^s-bs 2 )) 



.s£S 



N 



& E* 

i=l 



with Jij the interaction between spin i and spin j. In gen- 
eral, the arc quenched random variables chosen accord- 
ing to a certain distribution, e.g. a Gaussian in the case 
of the SK model or a Hebbian learning rule in the case of 
neural networks. 

A spin is updated through the spin-flip dynamics de- 
fined by the transition probability 



(7) 

We remark that self-couplings Ju are allowed to be present. 
This pseudo-Hamiltonian can be written in a two-spin rep- 
resentation 

H P (a,r) = -~ JiJViTj +bJ2tf + T D ( g ) 



Prfoft + 1) = s k G S\a(t)} 



exp[-/3ei(s fc |<r(t))] 
E se 5 ex P[-/ 3e »( s l cr W)] 



Here the energy potential ei[s|<r] is defined by [5] 

"1 



e»[s|<r] 



-hi(er)s — bs 



(2) 



(3) 



-- Jija^cx^t + l) 



(9) 



where b is the gain parameter of the system. The zero 
temperature limit T = /3 _1 — > of this dynamics is given 
by the updating rule 

CTj(i) -> Oi{t + 1) = s k : mmei[s\cr(t)} = ei[s k \cr(t)} . (4) 

This updating rule (@J) is equivalent to using a gain func- 
tion g 6 (-), 



In the limit (3 — > oo we find after some algebra starting 
from 

H P (a;T = 0) 

N Q 

= -E E 

i=l J = [ Q±3] 

X0(|/li(<7)| - + 

AT 

x0(6( Sj+Sj+1 )-|^HI) + &E^ ( 10 ) 



<7i(t + l) = g 6 (/ li ( < T(t)) 

46 (ac) = y ] s k [0 [b(s k+1 + s k ) - x] - 6 [b(s k + s k -i) - x]] 

(5) 



Q 

fe=i 



with the standard notation [•] indicating the largest inte- 
ger. For Q — 2, we find back the Hopfield Hamiltonian 
with an irrelevant additive constant. For Q = 3 we have 



N 



N 



with sq = -co and sq+i = +oo. The parameter b sup- 
presses or enhances the states of the spins that lie around 
the zero state. 

In the case of sequential updating it is well-known from 
detailed balance arguments that for symmetric couplings, 
i.e., Jij — Jji, and in the absence of self- interactions, i.e., 
Ju = 0, the equilibrium distribution for the Q-Ising sys- 
tem has the Boltzmann form with Hamiltonian (see, e.g., 

M) 



H s (<t) 



1 N 

- J i3 a i a 3 



N 
b^ 



i=l 



(6) 



valid for any temperature and with Lyapunov behaviour 
for T = 0. We remark that the second term is not a self 
coupling term. As in any spin model with sequential up- 
dating, the stationary solutions can only be fixed points. 

For synchronous updating a discussion does not seem 
to have appeared in the literature. In that case, the ar- 
guments of Peretto [3] can be generalized rather straight- 
forwardly to obtain that again the equilibrium probability 



H p (ct;T = 0) = (\hi(a)\ - b)6(\hi(tr)\ - &)+&E CT ' 

i=l i=l 

The Hamiltonian for general Q is bounded from below 
by H P (er; T = 0) > - Eij/i \ J ij\~ N \ b \ and > furthermore 

AH p {(t; T = 0) = H P {cr(t + 1); T = 0) - H P (a(t);T = 0) 

N 

= -£( -<(t + 2)-o- < (t)) 

i=l 

x (hi(a(t + 1)) - 6(oi(t + 2) + tTi(t))) < 

(12) 

indicating that the equilibrium behaviour can be fixed- 
points and/or cycles of period 2, i.e., <7j(t) = <7j(i + 2), 
Vi. 



2.2 The BEG model 

The second model we consider is the BEG model intro- 
duced in ^U] in the context of the A-transition and phase 
separation in the mixtures of He 3 — He 4 in a crystal field, 
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and recently discussed as a spin-glass (see |llll2j and ref- 
erences therein) and as a neural network model maximis- 
ing the mutual information content for ternary neurons 
|13ll4ll5j . This model can be described as follows. 

Consider N spins which can take values Cj, i = 1, . . . , N 
from a discrete set S = {— 1, 0, +1}. Given the configura- 
tion cr(t) = {<Tj(t)}, i = 1, . . . , N at time t, the spins are 
updated according to the spin-flip dynamics defined by 
the transition probability J5J) where the energy potential 
ei[s\cr(t)] is now defined by 



[s\a(t)} = -(hi,i(tr(t))s + h 2 ,i(<T(t))s 2 ) . 



(13) 



The local field /ii,i(<x) is the usual one as appearing, e.g., 
in ©, while the biquadratic /i2,i(o") local field is given by 



N 



(14) 



In the limit f3 — > oo this dynamics is given by the updating 
rule 

<ji{t + 1) = sign(/i M (<7(t)))0 {\hx,i{<r{t))\ + ha,i(tr(t))) 

(15) 

In the case of sequential updating of the spins the 
Hamiltonian is known in the literature mentioned above 
and given by 



ttBEG 



1 N 



(16) 



with J a = and = J,,*, for Vz, j. 

For synchronous updating detailed balance and sym- 
metry in the couplings lead to the pseudo-Hamiltonian 



H EEG (cr) =-~X> {2e^^ cosh (/3/^(<r)) + l} 

2 — 1 

(17) 



with as two-spin representation 

W) 

E t 7 './' 7 '" + K i3 a i T j) 



Hp EG 



(18) 



= - E {JiMt)v& + 1) + KijaUt)^(t + 1)) (19) 

Determining the dominant contributions in the limit /3 — > 
oo we find 



AT 



Hp EG (cr, t; T 



0) 



"Ed^ ")! + fta,i(o-)) 
f=i 

x 0(|/i M (o-)| +/i 2 .i(o-)) ■ (20) 



This form is clearly bounded from below and it can also 
be shown that the equilibrium behaviour is given by fixed- 
point attractors and/or cycles of period 2. 

Both the Q-Ising and BEG spin-glass models and neu- 
ral networks have been discussed in the literature starting 



from the Hamiltonian appropriate for sequential updating 
of the spins, as discussed in the introduction. Concerning 
synchronous updating, especially concerning the appear- 
ance and properties of two-cycles, very little seems to be 
written down, even for the ferromagnetic versions of these 
models. Since interesting different physics is involved we 
want to fill this gap in the following sections. 



3 Q-lsing ferromagnet: sequential versus 
synchronous updating 

3.1 Stationary behaviour 

We consider the Q-Ising (pseudo)-Hamiltonians for se- 
quential and synchronous updating derived before for sim- 
plified interactions of the form 



J i 



J_ 

N 



(21) 



where J can be positive or negative. The parameters de- 
scribing the properties of this system are the magnetiza- 
tion to and the spin activity a given by 



m(er) 



and in both cases the equilibrium behaviour can be studied 
by looking at the free energy per site, 



f=^lnZ, Z = Y,e X p(-pH(*)). (23) 



For sequential updating starting from the Hamiltonian 
© a standard calculation leads to the following free en- 
ergy 



Pfs = extr 



0J 



(24) 



with the effective Hamiltonian 

H s (a) = -Jma + ba 2 . (25) 
The saddle-point equation for m in this notation reads 



E g aexp(-/3ff(a)) _ 
£ CT exp(-/3H(«7)) 



(26) 



which is an effective thermal average, denoted by (•}. 

In the case of synchronous updating we start from the 
pseudo-Hamiltonian written in the two-spin representa- 
tion (JHJ. This Hamiltonian is symmetric with respect to 
the transformation er «-> r. The following result for the 
free energy is obtained 



Pfp = extr 



f3Jm a -m T — In /J exp(— (3H{a, r)) 



(27) 



4 



D. Bolle, J. Busquets Blanco: Two-cycles in spin-systems: multi-state Ising-type ferromagnets 



with the effective Hamiltonian 

H(a, t) = —Jm T a — Jrn a T + ba 2 + br 2 . 
The saddle-point equations for m a and m T read 

Ea,^e X p(-/3iI(<7,T)) 



E a , T exp(-/3#( ( x,r)) 
E CT , r ^exp(-/3g(a,r)) 
E ff , r exp(-/3#( ( r,r)) 



= (r) 



(28) 

(29) 
(30) 



where this again defines the average (•}. 

The effective Hamiltonian factorises over the two effec- 
tive spins, and so does the partition function. The saddle- 
point equations for m a and m T (|29() - (|30|l can be written 
as 

m a = F Q (m T ) , m T = F Q (m a ) (31) 
with the function Fq given by 

F Q (x) = E^exp/3^-^) 
2_^ a exp (3(Jxa — bo 1 ) 

The equations H31[) can be written as 

m a = F Q (F Q ( m<7 )) , m T = F Q {F Q {m T )) (33) 

and similar equations can be written down for the activity, 
for instance 



Gq(x) 



a a = G Q (F Q (m a )), 

& 2 exp (3( Jxa — ba 2 ) 



J2 a ex P (3(Jxa — ba 2 ) 



(34) 



At this point we remark that the saddle-point equation 
for the sequential Q-Ising model (|26ll is equivalent to m — 
FQ(m) and the activity satisfies a = Gg(m). 

For J > the function Fq (x) is monotonically increas- 
ing since 



dF Q (x) 
dx 



J2 a cT 2 expl3(Jxa-ba 2 ) 
J2 a exp/3(Jx(T — ba 2 ) 

J2 a a exp/3(Jxcr — ba 2 



V , r , M ( > 0.(35) 

2_^(t exp p\J xa — ba ) 

Consequently the right-hand side of 

(m a - m T ) 2 = (m a - m T ) (Fq (m T ) - F Q (m a )) (36) 

is always negative implying that m a = m T and 

fp = 2/s ■ 

In other words, the equilibrium states for both types of 
updating in the ferromagnetic Q-Ising model are the same. 
For J < 0, and also for the BEG-model, this is not valid 
as we will see in the following sections. 



3.2 An illustrative example: Q = 3 

The results for Q — 2 are standard textbook knowledge 
(see, e.g, QHl)- For Q = 3, the equations for Fq and Gq 
can be worked out explicitly 



G Q=3 (x) 



2 sinh (13 Jx) 



exp (fib) + 2 cosh ((3 Jx) 
F Q=3 (a:)coth (f3Jx) . 



(37) 
(38) 



The phase diagram for sequential updating is shown in 
fig. It is trivial to check that a negative J implies that 
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Fig. 1. Phase diagram for the sequential Q = 3 Ising ferro- 
magnet. The thick dashed (solid) line indicates the thermody- 
namic second (first) order transition between the ferromagnet 
and paramagnetic phase. The thin lines border the coexistence 
region. 



m = FQ = 3(m) only leads to a stable paramagnetic solu- 
tion m = 0. For positive J a transition occurs between 
the paramagnetic and the ferromagnetic phase. It is sec- 
ond order and given by the dashed line 



1 



(3b = In (2(/3 J -1)) 



(39) 



for (3 J < 3.01 and (3b < 1.39. It is first order above this 
tricritical point and given there by the thick solid line, 
which is the thermodynamic transition line found by com- 
paring free energies. Starting in the ferromagnetic phase 
for (3J > 3.01 and letting (3b become bigger we arrive at 
the first solid line where also the paramagnetic solution 
starts to be stable and, hence, the coexistence region II 
begins. This line is given by lEUl. At the thick full line, 
this paramagnetic solution becomes the global minimum 
of the free energy and at the second thin solid line given 

by 

m(coth((3J) -m) = — (40) 
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the ferromagnetic solution stops existing. It is interesting 
to remark that inside the m = phase, for any fij and 
fib > 2.89 only 10% or less of the spins remain in states ±1 
Furthermore, the phase diagram in the region of negative 
b is rather trivial since negative b tend to suppress all the 
zero states in the system. 

For synchronous updating the equations 1(33(1 - 1(34(1 are 
invariant under a change of sign of J, such that the corre- 
sponding [3 J — (3b phase diagram will be symmetric with 
respect to the axis J = 0. Furthermore, as shown before, 
the sequential and synchronous Q-Ising models have ex- 
actly the same stationary states for any J > 0. Therefore, 
the phase diagram is straightforwardly given in figure 
However, some caution is required here. From a study of 
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-10 -7.5 -5 -2.5 2.5 5 7.5 10 
fij 

Fig. 2. Phase diagram of the synchronous Q = 3 Ising ferro- 
magnet. The lines are as in fig. 1 

the dynamics, similar to the one presented for the BEG- 
model in the next section, one becomes aware of the dif- 
ference between the regions J > and J < 0. For positive 
J, all stationary solutions are fixed-points, while for neg- 
ative J the m — solution (stable in / and II) is of the 
same nature as for J > 0. The m ^ solution (stable in 
II and III) is a two-cycle, and the system jumps from m 
to — m with the activity a constant. 



4 BEG ferromagnet: statics for sequential 
and synchronous updating 

We recall the (pseudo)-Hamiltonian for sequential and 
synchronous updating 1(16(1 respectively 117(1 and choose 
ferromagnetic couplings 



j.. = L 



Ki 



K 

N 



(41) 



The order parameters describing the properties of the sys- 
tem are defined as in ((22(1 . 



For sequential updating a standard calculation leads 
to the free energy 



<| \fiJm 2 



\fiKa 2 



In 



2 exp (fiKa) cosh (/3Jm) + 1 



(42) 



and the following fixed-point equation must be satisfied 

2 sinh (pjm) 



exp (-fiKa) + 2 cosh (fiJm) 
2 cosh (fiJm) 



exp (-fiKa) + 2 cosh (fiJm) 
For synchronous updating the free energy becomes 
fifp = extr {fiJrria-mr + fiKa a a T 

ma ,m T ,a CT ,a T 

+ In [(2 exp (fiKa a ) cosh (fiJm a ) + 1) 



(43) 
(44) 



m T = F B£;G (m (T ,a CT ) 
a T = G beg (ma, a<j) 



(46) 
(47) 



x (2exp(/3ifa T )cosh(/3Jm T ) + 1)]} (45) 

with m<j, m T , a CT , a T satisfying the saddle-point equations 

m a = F BEG (m T ,a T ) 
a<y = GBEG(m T ,a T ) . 

and the functions FbeGtGbeg given by 

2 sinh (/3 Jx) 

Fbeg(x, V )= exp (_ /3Ky) + 2coah{/3Jx) ( 48 ) 
Gbeg (x,y) = Fbeg (x) coth (fiJx) . (49) 

It is clear that the results for sequential updating can 
then be written as 



m = Fb (m, a) , a = Gb (jn, a) 
and the results for synchronous updating satisfy 



m„ 



= Fb (Fb (jn G , a a ), Gb (TOo-j o-a)) 
GB(FB(m r7 ,a rT ),GB(m c7 ,a CT )) 



(50) 



(51) 
(52) 



where, for convenience, we have simplified the subscript. 

These relations form again the basis for studying the 
differences and similarities between sequential and syn- 
chronous updating in the BEG model. Let us first look at 
the phase diagram for sequential updating shown in fig- 
ure|21 For J < the only stable solution is given by m = 
and the single value a = Gb(0, a) = 2 [2 + exp (— fiKa)]^ 1 . 
For J > we see from ((4411 that, when m ^ and K ^ 0, 
a — m coth (fiJm) . 

The transition between the paramagnetic and ferro- 
magnetic phase is given by the dashed line 

a =J~ r fiK = -fiJ\n(2(fiJ-l)) (53) 

in analogy with the transition line ((39|) for the Q — 3 Ising 
ferromagnet. It is second order for all coupling parameters, 



6 
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Fig. 3. Phase diagram for the sequential BEG ferromagnet. 
The lines are as in fig. 1 



from the sequential one a 
point 



Gbeg{0,cl) at the following 



(3K = 



-1 



all 



1 = (1 - a) In 



2(1 - a) 



(54) 



a)' 

giving the result a* ~ 0.316 and /3K* ~ -4.623. This 
bifurcation line is indicated in fig. 0] as the dashed-dotted 
line. It separates the regions I-II and V- VI in the phase 
diagram. For (3K < [3K* , the two new solutions appearing 
at that point become automatically the stable ones in the 
phases where to = is stable (II, III, and IV), while the 
sequential solution becomes unstable. Figure illustrates 
this behaviour. In region /, where only the solution to = 
is stable, the unique and stable solution for a is a = 
Gb{0, a)- In addition, for (3K < (3K* the transition line 
(I53|l becomes simply the border where the ferromagnetic 
solution starts to exist, but is not yet stable, since in region 
III the ferromagnetic solution is only a minimum of the 
free energy in the to direction. At this point we remark 
that in figure El still other spurious unstable solutions can 
be seen, i.e., the loops in the top figure. 



in contrast with the one for the Q — 3 Ising model. We 
remark that inside the paramagnetic phase, only 10% of 
the spins (or less) remain in the states ±1 below j3K ~ 
-28.904. 

For synchronous updating the phase diagram is more 
involved as can be seen in figure First we note that 
the set of equations l|52l) is invariant under the change of 
sign of J, such that the phase diagram is symmetric with 
respect to the J = axis. 
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-10 -7.5 -5 -2.5 2.5 5 7.5 10 
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Fig. 4. Phase diagram for the synchronous BEG ferromagnet. 
The dashed-dotted line indicates the bifurcation of solutions 
in a. The rest of the lines is as in fig. 1 



In the case to = one finds from eq. I|52J) that the 
equation for a is given by a — Gb(Gb(0,o,)). For certain 
values of (3K, this equation has three solutions bifurcating 



VI j 


i vi 




i \ 






IV yS/ / 

/ / II 
III / 


// \ \ 
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().« 



0.6 
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Fig. 5. Stationary limit of m and a as a function of (5K given 
j3J = 7. The same labels correspond to the same points. Solid 
lines denote stable solutions, while dashed lines indicate un- 
stable ones. 



Simulations and the dynamics of the BEG-model dis- 
cussed in the next section show that in the paramagnetic 
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phase 77, for (3K < (3K*, the system oscillates between 
the two stable solutions for a and, therefore, the equilib- 
rium configuration is a cycle of period 2 where both con- 
figurations involved have different a values which become 
equal to and 2/3 when f3K — ► — oo. 

We find that below j3K* the transition from the para- 
magnet to the ferromagnet phase becomes first order. Com- 
paring numerically the free energies we find the first or- 
der thermodynamic transition indicated by the thick solid 
lines in fig. 0] The tricritical point is given by f3J ~ 
±3.160, (3K ~ —4.623. As a consequence, as in the Q — 
3 Ising model and in contrast with the sequential BEG 
model, there is a coexistence region bordered by the thin 
solid lines. Again, these lines can be obtained analytically. 
Starting in the stable paramagnetic phase m = for, to 
fix ideas, (3 J = 7 and increasing the value of /3K we find 
the following. We first meet the thin dashed line where 
the ferromagnetic solution m > appears but is still un- 
stable. This line coincides with the transition line in the 
sequential BEG model (recall fig. |3J) because the sequen- 
tial solution is also a solution here. In region III this 
ferromagnetic solution stays unstable until we meet the 
solid line between regions III and IV, being the lower 
border of the coexistence region. This line is given by the 
point where the ferromagnetic free energy becomes a (lo- 
cal) minimum in the a direction, i.e., 



dGsirn, a) 



(20K - a) — _ (/3J )2 (a 2 _ 



2 / dF B {m,a) 



(1-a) 



da 



9Gs(m, a) 
da 



L ais n I ,dG B {m,a) dF B (m,a) 
+jjKaGB{m, a) pJm&B[m, a)- 



+2(3Jf3Km 



da 

dFB(m, a) <9Gs(m, a) 



da 



da 



da 



= 



(55) 



where Fb(to, a) and Gs(m, a) are defined in <|48|l and (|49|l . 

Next, we meet the thermodynamic line discussed be- 
fore where the ferromagnetic solution becomes a global 
minimum of the free energy. Increasing (3K further we 
arrive at the border of region IV and V where the para- 
magnetic solution becomes unstable. It is given by 



2(pJ) 2 a 



exp(-/3Ka) + 2 



(56) 



This equation has two solutions. The first solution a — 
Gb{0, a) gives the separation line between regions I and 
VI, which corresponds to the transition line in sequential 
updating (fig. El- The second solution a = G b (Gb(0, a)) ^ 
Gb{0, a) gives the upper border of the coexistence region 
IV. The last line we meet is the separation between re- 
gions V and VI, as found in eq. (|54p. In regions V and 
VI, only the ferromagnetic solution is stable. 

These results allow us to say that sequential and syn- 
chronous updating lead to completely the same physics 
(f P = 2/ s ) in the region j3J > 0, (3K > -4.623. Hence, 
as we will further explain in the next section on dynamics 



there are no cycles for positive couplings, but we do find 
them for positive (3 J and negative f3K . They turn out to 
be stable in the regions II, III and IV. 



5 BEG ferromagnet: dynamics for sequential 
and synchronous updating 



The aim of this section is to study the dynamics of the 
BEG model in order to further examine the difference be- 
tween sequential and synchronous updating and to further 
understand the appearance and behaviour of two-cycles. 
In order to do so we use the generating function (path 
integral) technique introduced in f^Jj to the field of sta- 
tistical mechanics and, by now, part of many textbooks. 
In particular, we follow |18| . Since we have no disorder in 
our problem, the method can be used in its simplest form. 

The probability of a certain microscopic path of spin 
configurations from time up to time t is denoted by 
P[er(0), ...,er(i)]. For the BEG model defined in section^] 
it is given by 



P[<r(0), <r(t)] = P o (<x(0)) J] W[a{8 + 1); <r(s)} (57) 

s=Q 

with W[u; a'] the transition matrix of the Markovian pro- 
cess defined by the spin- flip dynamics given by eqs. @ and 
(|13|l . It depends on the specific way of updating the spins 
(sequential or synchronous) and will be specified later. We 
introduce a generating function for the BEG model as a 
function of the field 



Z[#] = ( exp 



s=0 i=l fe=l 



(58) 



path 



where the average {-) P ath is an average over P[cr(0), ...,cr(t)]. 
The order parameters of the system are generated by this 
function Z[$>] through 



(&i( s )}path = i lim 



dZ[$>] 



\ d(j) ki i(s) 



(59) 



At this point we remark that, for our purposes, we only 
look at these one-time quantities. Again, to unify notation 
we use the "magnetizations" nik(s), k = 1,2 to denote 
the magnetization m(<x(s)), respectively the spin activity 
a(cr(s)). 

Introducing these magnetizations into the generating 
function (|58|l by using appropriate 5 functions and group- 
ing the terms in those depending on the site index and 
those which do not, we obtain 



Z\<&\ oc / Y\_ [dmjfedmjfe] expA^ 

** i. 



(60) 
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with dm k — dmk(0)...dmk(t) and similarly for dm k . The 
quantity & reads 



■l^ln/exp 



■^2a!?(s)(m k (s) + <f> k ,i(s)) 




This generating function (|6(J[1 allows for the application of 
the saddle-point method. In order to continue we need to 
specify the type of updating. 



5.1 Synchronous updating 



In this case all spins are updated at the same time such 
that the transition probabilities W p [cr(s + 1); cr(s)] are just 
the product of the transition probabilities of the single 
spin (recall eqs. J5J) and (|13|0 . Noting that the local fields 
are equal to h k (s) = J k m k (s) (with obvious definitions for 
Jfe) we obtain 



9 = i J2 rh k (s)m k ( S ) + ^£ ln £ £ Po(<x(0)) 

k,s i <T(0) <J(t) 

cxp [-i}^a^(s)(ihk{s) + (pk,i( s ) + i(3J k m k (s - 1))] 



exp 



^ In (l + 2e' 3j2 " l2 ( ;s - 1 ) cosh {l3J imi {s - 1)) 



(62) 



Choosing the initial conditions Po(<r(0)) to be iidrv with 
respect to i and letting <j) kt i — > 0^, the single-site nature of 
the last expression becomes apparent. Defining an effective 
(i.e., single-site) path average denoted by (•)* the saddle- 
point equations then become 



m k {s) = (cr (s)}* , m k (s)=0. 



(63) 



Working out further details and summing over the spins 
we easily obtain 



mi(s) 



2e PJ2m 2 (s-l) S inh(/3JiTOi(s - 1)) 



(64) 



1 + e p.hm 2 ( s ~i) cosh(/3Jimi(s - 1)) 
m,2(s) = mi(s) coth( / 9Jimi(s — 1)) . (65) 

These saddle-point equations allow for two-cycles when 
m k (s) = m k (s+2), k = 1, 2 and fixed points with m k {s) = 
m k (s + 1). The stationary limit is obtained when we drop 
the time dependence, writing m k (s) as m CT and m k (s — 1) 
as m T or the other way around. Some further discussion 
and numerical results will be presented after studying se- 
quential updating. 



5.2 Sequential updating 

We start from the stochastic process 

Ps+i((t) = 22 W s [o-,o-']p s (a') 



(66) 



cr' 



with p s+ i(cr) the probability to be in a state er at time 
s + 1. For the BEG model 



t " 5 ""'I = n i w i( (T ) S <r,<r' 



N 

Wi(FiCr)5cr,Gi(T' + Wi(G t cr)5cr, F z cr>} (67) 



with the shorthand Wi(cr) = P{<7i(s + 1) = (7i\cr(s)} and 
where Fi and Gi are cyclic spin-flip operators between the 
spin states {-1,0,+!} defined by 



Fi$(cr) =#(<T 1 ,...,(T i _i 
G t <P{cr) = Fi(Fi$(cr)) . 



-3af - a* 



a N ) 
(68) 



Each time step a randomly chosen spin is updated. In the 
thermodynamic limit the dynamics becomes continuous 
because the characteristic time scale is N . The stan- 
dard procedure is then to update a random spin accord- 
ing to @ and (|13[1 with time intervals A that are Poisson 
distributed with mean TV -1 [E]. We can then write a con- 
tinuous master equation in the thermodynamic limit 



—Ps(er) = lim 



Ps+a{(t) -Psjcr) 
A 

= £{M«r)-l)p.(«r) 

i 

+ Wi(Fnr)p.(Fitr) + Wi(Gitr)p a (Gnr)} (69) 

Starting again from the generating function (|6t)|l - H61(l . 
the average over the paths has to be understood as an av- 
erage over a constrained process given by eqs. (|6H | - l|H7j) in 
which the overlaps are prescribed at all time steps. There- 
fore, due to the introduction of the m k (s) and rhfc(s), 
the transition probabilities should be written as a func- 
tion of these overlaps. iUi(<x(s)) — > Wi(mi(s), m,2(s)). The 
key step is to write this stochastic process as a single-site 
problem. This is possible when noting that the p s (cr) can 
be written as 



N 



1 2 , °i - ( \ , ( 3<7 i 

1 - °i + + I — 



1 m 2 i(s) 



(70) 

where, in order to satisfy eq. (|69|l the fhh As) = (crf(s)) pa th 
have to obey the following evolution equations 

d _ 

Jt m 14 {s) 



2e /3J2m 2 ( S ) sinh (j3J imi ( s ^ 

~ 1 + 2e' 3j2m2 ( s ) cosh(/3Jimi(s)) 

2e /3j2m2 ( s )cosh(/3Jimi(s)) 
~~ 1 + 2e^ J 2m2(s) cosh(/3JiTOi(s)) 



mi,i(s) (71) 



- m 2 ^(s) (72) 
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with the initial conditions po(&) = <5<t,<t(o)- These evolu- 
tion equations are clearly site independent. 

The function for continuous time then reads 



& = i 



E 

k 



^ln/exp 



N 



dsm k (s)m k (s) 

/ dsaf(s)(m k (s)+4> kii (s)) 



path 

(73) 



and by choosing the initial conditions iidrv with respect to 
i and letting (p^ i — > 0^ the single-site nature is complete. 
Defining an effective path average denoted, as before, by 
(•)*, the saddle-point equations are formally the same as 
eqs. I)63[) implying that n%k(s) — rhki(s), Vi. Hence, the 
final evolution equations for the order parameters of the 
BEG model with sequential updating are 



d 

dt mi{s) 

2e' 3j2m2 ( s )sinh(/3Jimi(s)) 
"~ 1 + 2ef }J ^ m ^ cosh(/3Jimi(s)) 

m 2 (s) 

1 + 2e' 3J 2 m 2( S ) cosh (/3Ji mi (s)) 



dt 



mi (s) (74) 



m 2 {s) (75) 



Clearly, the stationary solutions obtained by forgetting 
about the time dependence do not allow two-cycles. 



5.3 Simulations and numerical results 

We illustrate our findings by showing some numerical re- 
sults and comparing these with simulations for up to N = 
500000 spins. Recall figs.|21and0] For some typical values 
of the couplings in the ferromagnetic phase, e.g., /3Ji = 
(3 J = 3, (3 J 2 — (3K = 1 in region VI, both types of updat- 
ing lead to the same stationary state, with mi ~ to 2 — 1, 
the only difference being the speed with which this hap- 
pens: sequential updating seems to be a bit slower. For 
0J = —3 and (3K = 1 sequential updating leads to mi — 
m = 0, rri2 = a ~ 0.8 while synchronous updating gives a 
cycle in m with \m\ ~ a ~ 1. Simulations for these cases 
are in excellent agreement with these results. 

The second set of points lie in region IV of the phase 
diagram fig. 4, i.e., (3 J = ±8 and (3K = — 10 and the 
results of the dynamics are shown in figs.EJandd The dots 
correspond to simulations points. When (3 J > (fig. 01 
we see that the sequential system (bottom) always goes 
to the ferromagnetic solution for any initial condition. We 
note that for sequential dynamics, t — 1 corresponds to 1 
update per spin in average. The synchronous system (top), 
however, has two minima in the free energy, and depending 
on the initial condition it evolves to the m = solution 
or to the m > ferromagnetic one. In addition, the basin 
of attraction is somewhat involved in the sense that the 
initial conditions m(0) = 0.8 (a — 0.9) and m(0) = 0.05 





Fig. 6. Evolution of m and a as a function of time for se- 
quential (bottom) and synchronous (top) updating for (3 J = 8, 
f3K = —10. The dots correspond to simulation points. For syn- 
chronous dynamics, the paths leading to a cycle in a have been 
plotted with dashed lines. 



(a = 0.1) lead to the m — solution, while the initial 
conditions m(0) = 0.5 (a = 0.6) and m(0) = 0.2 (a = 0.3) 
lead to the ferromagnetic one. The behaviour in a is as 
expected: when m reaches the ferromagnetic solution, a 
tends to a single finite value, while when m = 0, a enters a 
two-cycle. Indeed we are in the region of the phase diagram 
where three solutions for a are allowed (recall fig-EJ). For 
the sake of clarity, we have only included one of the cycles 
in a for the synchronous updating figures (the one for 
m(0) = 0.8, o(Q) = 0.9) 

When (3 J < (fig. |7|) the sequential system always 
evolves to the m = solution, while the synchronous one 
shows a similar behaviour as in fig. El the only difference 
being that now the ferromagnetic solution is a two-cycle 
in m. 
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In the case of the Q = 3 Ising model, no surprising 
behaviour has been found in the sense that the phase dia- 
gram for synchronous updating is symmetric with respect 
to the zero-coupling axis J = 0, and that the same station- 
ary solutions appear as for sequential updating except for 
negative couplings where cycles of period two in m occur 
in the ferromagnetic phase. 

The differences in the behaviour of the BEG (anti)- 
ferromagnet are partly unexpected. Whereas the phase 
diagram for sequential updating is even simpler than the 
corresponding one for the Q — 3 Ising model, a much 
richer phase diagram appears in the case of synchronous 
updating. Symmetry with respect to the axis J = still 
persists in this case, but the presence of a second relevant 
order parameter allows for much richer behaviour. The 
region of negative K coupling is characterized by a more 
complicated free energy landscape. For instance, when j3K 
is sufficiently negative three paramagnetic solutions exist 
with different values for the spin activity, two-cycles in a 
appear in different regions of the parameter space and a 
coexistence region of the ferromagnetic and paramagnetic 
solutions is found for certain values of the coupling param- 
eters. When looking at the Hamiltonian of the BEG sys- 
tem, one expects the most interesting behaviour in the re- 
gion J > 0, K < (also J < for synchronous dynamics), 
since both terms in the Hamiltonian favour different states 
for the spins. Moreover, the fact that for synchronous dy- 
namics one has to work with two types of spins makes the 
picture still more involved. 

These findings suggest that also in more complicated 
disordered spin systems like the BEG spin-glass or neu- 
ral network the differences between sequential and syn- 
chronous updating might be much richer and more inter- 
esting than one expects. 



Fig. 7. Evolution of m and a as a function of time for sequen- 
tial (bottom) and synchronous (top) updating for [3J — —8, 
f3K = —10. The dots correspond to simulation points. For 
synchronous dynamics, the paths leading to a cycle in a have 
been plotted with dashed lines. 
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6 Concluding remarks 

In this paper we have studied some of the physical conse- 
quences of the way spins are updated, sequentially respec- 
tively synchronously, in classical multi-state Ising-type spin 
systems. First, we have derived the general form of the 
(pseudo-) Hamiltonian for Q-Ising and Blume-Emery- Grif- 
fiths (BEG) spin-glasses with synchronous updating on 
the basis of detailed balance. 

Next, in order to study the precise differences in the 
stationary behaviour we have chosen to simplify these 
models to Q-Ising and BEG (anti-) ferromagnets, on the 
one hand because these are exactly solvable both through 
a free-energy analysis and a functional integration ap- 
proach and on the other hand because we did not find 
these results in the literature. 
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